QUANTIFYING THE BORDERLINE CANDIDATE IN STANDARD SETTING

نویسندگان

چکیده

Background: Conceptualising the Borderline candidate is one of most difficult tasks in standard setting. However, it also central to process. Here we set out develop a methodology by which score borderline candidates can be retrospectively calculated from Facility index (the percentage items answered correctly) assessment items. Methods: We explored performance all an academic year UK medical school, covering 26 separate assessments. Each had previously been either Angoff or Regressions methods. We identified reviewing their across assessments year. A student was classed as 'Borderline' if they were within 1 Standard Error Measurement above pass score, below when variety cut-off points experimentally. plotted item scores each method comparison with for whole cohort, and fitted curves resulting distributions. Results: Borderline intercepted self-plot at two places - facility 100% 20%. These correspond getting correct guessing outcome. observed strong curvilinear distribution showed compared cohort. This relationship well described exponential form y ≈ C·exp(F·x), where on that Item, x Item C F are constants. We found similar values under different conditions. Using typical cohort facility, could predict probable over test: other words, calculate appropriate cut candidates. Differentiating equation indicates ought sensitive. Conclusions: This approach used standard-set entirety low stakes norm referenced, preference Cohen Where methods based (or very small number candidates), this therefore more robust. In high assessments, value, its use context General Medical Council proposed national exam. It novel such Very Short Answer formats, setting panels unfamiliar expected these items.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Standard setting in medical education: fundamental concepts and emerging challenges

  The process of determining the minimum pass level to separate the competent students from those who do not perform well enough is called standard setting. A large number of methods are widely used to set cut-scores for both written and clinical examinations. There are some challenging issues pertaining to any standard setting procedure. Ignoring these concerns would result in a large dispute ...

متن کامل

assessing the reliability of the borderline regression method as a standard setting procedure for objective structured clinical examination

background: one of the methods used for standard setting is the borderline regression method (brm). this study aims to assess the reliability of brm when the pass-fail standard in an objective structured clinical examination (osce) was calculated by averaging the brm standards obtained for each station separately. materials and methods: in nine stations of the osce with direct observation the e...

متن کامل

The Dynamics of Standard Setting

The purpose of this article is to analyse the dynamics of social networks in standard making process, and to show how a standard becomes a means for aligning complex social networks. Alignment of networks is nothing but an alignment of actors' interests involved in the standard making process. The standardisation process is communication rich and the dynamics of networks is based on information...

متن کامل

Scientific components in standard setting.

Although it has not, to my knowledge, been precisely articulated, one concept of the scientific component of determination of a standard is that, first, all relevant published data are collected; second, a process is undertaken to derive some consensus on the reliability or meaning of the research; and third, the resulting document is transmitted to those charged with recommending a standard. S...

متن کامل

Who will pass the dental OSCE? Comparison of the Angoff and the borderline regression standard setting methods.

AIM Aim of this study is to elucidate which standard setting method is optimal to prevent incompetent students to pass and competent students to fail a dental Objective Structured Clinical Examination (OSCE). MATERIAL AND METHODS An OSCE with 14 test stations was used to assess the performance of 119 third year dental students in a training group practice. To establish the pass/fail standard ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: EDULEARN proceedings

سال: 2021

ISSN: ['2340-1125', '2340-1117']

DOI: https://doi.org/10.21125/edulearn.2021.0677